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BACKGROUND OF THE INVENTION 

1. FIELD OF THE INVENTION 

5 This invention relates to the field of computer software, and. rr>™° 

specifically, to object-oriented computer applications. 

r C3S? 

j| Portions of the disclosure of this patent document contain material 

H that is subject to copyright protection. The copyright owner has no objection 

^QlO to the facsimile reproduction by anyone of the patent document or the patent 

v2 

yl disclosure as it appears in the Patent and Trademark Office file or records, but 

□ otherwise reserves all copyright rights whatsoever. Sun, Sun Microsystems, 

|I the Sun logo, Solaris, SPARC, "Write Once, Run Anywhere", Java, JavaOS, 

5 JavaStation and all Java-based trademarks and logos are trademarks or 

U 15 registered trademarks of Sun Microsystems, Inc. in the United States and 
other countries. 

2. BACKGROUND ART 

20 With advancements in network technology, the use of networks for 

facilitating the distribution of media information, such as text, graphics, and 
audio, has grown dramatically, particularly in the case of the Internet and the 
World Wide Web. One area of focus for current developmental efforts is in 
the field of web applications and network interactivity. In addition to passive 

25 media content, such as HTML definitions, computer users or "clients" 
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coupled to the network are able to access or download application content, in 
the form of applets, for example, from "servers" on the network. 

To accommodate the variety of hardware systems used by clients, 
5 applications or aoolfts *re distributed in a platform-independent format such 
as the Java™ class file format. Object-oriented applications are formed from 
multiple class files that are accessed from servers and downloaded 

*3 individually as needed. Class files contain bytecode instructions. A "virtual 

CP 

H machine" process that executes on a specific hardware platform loads the 

iijlO individual class files and executes the bytecodes contained within. 

°q A problem with the class file format and the class loading process is 

=1 that no mechanism is provided to ensure timely delivery of class files. The 
K timing of the storage, transfer and processing of the individual class files is 
13 15 thus not scheduled or guaranteed to occur within a particular time frame. 

Also, an application may contain many class files, all of which are loaded and 
processed in separate transactions. Thus, a delay in the delivery of even one 
class file slows down the application and degrades performance. 

20 These problems can be understood from a review of general object- 

oriented programming and an example of a current network application 
environment. 
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Object-Oriented Programming 

Object-oriented programming is a method of creating computer 
programs by combining certain fundamental building blocks, and creating 
5 relationships among and between the building blocks. The building blocks in 
object-oriented programming systems are called "objects." An object is a 
^ programming unit that groups together a data structure (one or more 

instance variables) and the operations (methods) that can use or affect that 

CP 

H data. Thus, an object consists of data and one or more operations or 
-3 10 procedures that can be performed on that data. The joining of data and 
tti operations into a unitary building block is called "encapsulation." 

|I An object can be instructed to perform one of its methods when it 

it receives a "message." A message is a command or instruction sent to the 
u 15 object to execute a certain method. A message consists of a method selection 

(e.g., method name) and a plurality of arguments. A message tells the 

receiving object what operations to perform. 

One advantage of object-oriented programming is the way in which 
20 methods are invoked. When a message is sent to an object, it is not necessary 
for the message to instruct the object how to perform a certain method. It is 
only necessary to request that the object execute the method. This greatly 
simplifies program development. 
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Object-oriented programming languages are predominantly based on a 
"class" scheme. The class-based object-oriented programming scheme is 
generally described in Lieberman, "Using Prototypical Objects to Implement 
Shared Behavior in Object-Oriented Systems," OOPSLA 86 Proceedings, 
5 September 1986, pp. 214-223. 

n A class defines a type of object that typically includes both variables and 

=| methods for the class. An object class is used to create a particular instance of 

r t an object. An instance of an object class includes the variables and methods 

flO defined for the class. Multiple instances of the same class can be created from 

® an object class. Each instance that is created from the object class is said to be 

Q of the same type or class. 

f A 

□ To illustrate, an employee object class can include "name" and "salary" 

"15 instance variables and a "set_salary" method. Instances of the employee 
object class can be created, or instantiated for each employee in an 
organization. Each object instance is said to be of type "employee." Each 
employee object instance includes "name" and "salary" instance variables and 
the "set_salary" method. The values associated with the "name" and "salary" 
20 variables in each employee object instance contain the name and salary of an 
employee in the organization. A message can be sent to an employee's 
employee object instance to invoke the "set_salary" method to modify the 
employee's salary (i.e., the value associated with the "salary" variable in the 
employee's employee object). 

25 
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A hierarchy of classes can be defined such that an object class definition 
has one or more subclasses. A subclass inherits its parent's (and grandparent's 
etc.) definition. Each subclass in the hierarchy may add to or modify the 
behavior specified by its parent class. Some object-oriented programming 
5 languages support multiple inheritance where a subclass may inh^ * ~ u< -s 
definition from more than one parent class. Other programming languages 
□ support only single inheritance, where a subclass is limited to inheriting the 
H class definition of only one parent class. The Java™ programming language 
% also provides a mechanism known as an "interface" which comprises a set of 
% 10 constant and abstract method declarations. An object class can implement the 
ys abstract methods defined in an interface. Both single and multiple 
R inheritance are available to an interface. That is, an interface can inherit an 
^ interface definition from more than one parent interface. 

15 An object is a generic term that is used in the object-oriented 

programming environment to refer to a module that contains related code 
and variables. A software application can be written using an object-oriented 
programming language whereby the program's functionality is implemented 
using objects. 

20 

Tava™ Programming and Execution 

A Java™ program is composed of a number of classes and interfaces. 
Unlike many programming languages, in which a program is compiled into 
25 machine-dependent, executable program code, Java™ classes are compiled 
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into machine independent bytecode class files. Each class contains code and 
data in a platform-independent format called the class file format. The 
computer system acting as the execution vehicle contains a program called a 
virtual machine, which is responsible for executing the code in Java™ classes. 
5 The virtual m?^ u; ^? ^-ovides a level of abstraction between the machine 
independence of the bytecode classes and the machine-dependent instruction 
O set of the underlying computer hardware. A "class loader" within the virtual 
gfj machine is responsible for loading the bytecode class files as needed, and 
% either an interpreter executes the bytecodes directly, or a "just-in-time" (JIT) 
^ 10 compiler transforms the bytecodes into machine code, so that they can be 
* M executed by the processor. 

Sample Tava™ Network Application Environment 

Li 

15 Figure 1 is a block diagram illustrating a sample Java™ network 

environment comprising a client platform 102 coupled over a network 101 to 
a server 100 for the purpose of accessing Java™ class files for execution of a 
Java™ application or applet. 

20 In Figure 1, server 100 comprises Java™ development environment 

104 for use in creating the Java™ class files for a given application. The 
Java™ development environment 104 provides a mechanism, such as an 
editor and an applet viewer, for generating class files and previewing applets. 
A set of Java™ core classes 103 comprise a library of Java™ classes that can be 

25 referenced by source files containing other/new Java™ classes. From Java™ 
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development environment 104, one or more Java™ source files 105 are 
generated. Java™ source files 105 contain the programmer readable class 
definitions, including data structures, method implementations and 
references to other classes. Java™ source files 105 are provided to Java™ 
5 compiler 106, which compiles Java™ source files 105 into compiled ".class" 
files 107 that contain bytecodes executable by a Java™ virtual machine. 
^ Bytecode class files 107 are stored (e.g., in temporary or permanent storage) on 
server 100, and are available for download over network 101. 

Eh 

*j 10 Client platform 102 contains a Java™ virtual machine (JVM) 111 

Cm which, through the use of available native operating system (O/S) calls 112, is 
Q able to execute bytecode class files and execute native O/S calls when 
U necessary during execution. 

k ~ 15 Java™ class files are often identified in applet tags within an HTML 

(hypertext markup language) document. A web server application 108 is 
executed on server 100 to respond to HTTP (hypertext transport protocol) 
requests containing URLs (universal resource locators) to HTML documents, 
also referred to as "web pages." When a browser application executing on 
20 client platform 102 requests an HTML document, such as by forwarding URL 
109 to web server 108, the browser automatically initiates the download of the 
class files 107 identified in the applet tag of the HTML document. Class files 
107 are typically downloaded from the server and loaded into virtual 
machine 111 individually as needed. 

25 
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It is typical for the classes of a Java™ program to be loaded as late 
during the program's execution as possible; they are loaded on demand from 
the network (stored on a server), or from a local file system, when first 
referenced during the Java™ program's execution. The virtual machine 
5 locates and loads each class file, parses the class file format, allocates memory 
for the class's various components, and links the class with other already 
fa * loaded classes. This process makes the code in the class readily executable by 
the virtual machine. 

"'2 10 Timely Delivery 



m 



9 



There are a variety of applications for which Java™ byte code or 
serialized objects need to be delivered to clients in a timely fashion. For 
example, ensuring timely delivery of byte code is essential when Java™ byte 
15 code is used to control time aware media in a push scenario. 

Currently, there has been no mechanism available for delivery of byte 
code in a timely fashion. Currently, the techniques for delivery of byte code 
use Transmission Control Protocol (TCP) to transmit byte code from servers 
20 to clients. TCP does not ensure timely delivery of information. 

There are a number of schemes (e.g., Motion Picture Experts Group 
(MPEG) standards, such as MPEG-1, MPEG-2, MPEG-4, etc.) available for 
preparing time-sensitive data (e.g., audio, video, etc.) for transmission as 
25 media streams. Similarly, there are a number of schemes like Real-time 
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Transport Protocol (RTP) and MPEG-2 transport stream, to deliver "time 
aware" media streams in a timely manner. "Time aware" information is 
information that carries with it additional information representing timing 
relevant to the use of the information. For example, information that 
5 includes time stamps indicating deadlines by which the information ^^^a 
be processed in certain ways is considered "time aware" information. 

;S However, such techniques are designed to deliver media stream, such 

f t as audio and video data, not executable byte code. Media streams typically 

^1 10 comprise information that is inherently tolerant of corruption or loss of 

^ integrity. For example, transient corruption of a few milliseconds of audio or 

EE 

13 video data creates only a brief distraction for a listener or viewer. However, 
M* the slightest corruption of executable byte code can prevent proper execution. 

y- 

C3 

c : 

™ 15 Moreover, one class file of byte code is often dependent upon other 

class files for proper execution. Existing techniques for timely delivery of 
media streams do not include provisions for these dependencies. Thus, a 
technique is needed to provide timely delivery of byte code. 

20 A technique is needed to transform the class file (or a serialized object) 

into a time aware stream. If the Java™ byte code stream were made time 
aware, other real time transport mechanisms like RTP could be used to 
transport the stream in a timely fashion. Such a scheme would facilitate the 
use of byte code in any multicast or broadcast scenario. This would make it 

25 possible to transmit byte code using internet protocols like User Datagram 



83000.1035/P3327/JTF 



10 



Express Mail #EL111264142US 



Protocol (UDP). Without such a scheme UDP is unsuitable for delivery of 
byte code since UDP is an unreliable protocol (one that does not guarantee 
delivery of data). Transmission of byte code over an unreliable protocol could 
result in loss of portions of the byte code, which would prevent the byte code 
from executing p^pe'l". 
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SUMMARY OF THE INVENTION 

A method and apparatus for providing timely delivery of a byte code 
stream is described. Embodiments of the invention avoid the disadvantages 
5 of existing transport techniques. For example, untimeliness and unreliability 
of delivery are avoided. 

w 

5 Embodiments of the invention enable timely delivery of Java™ byte 

H° code in a multicast/broadcast scenario with or without a back channel. The 
M3 10 same mechanisms can also be used for delivering (serialized) objects. 
(H Multicasting allows transmission of a specially addressed data stream to many 
q users. With multicasting, the data stream does not need to be individually 
J. transmitted to each user. Rather, the users can subscribe to the multicasting 
P service, for example by specifying the address of the specially addressed data 
u 15 stream. Broadcasting allows transmission to users without the subscription 
process of multicasting. 

Embodiments of the invention are suitable for use with "push" media, 
where information is transmitted to users without the need for users to 
20 request the information. "Push" media can be transmitted even in 
environments where there is no back channel to allow the users to 
communicate back to the source of the media. Embodiments of the 
invention are also suitable for use with "pull" media, where users request 
information from the source of the media. 

25 
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Embodiments of the invention serve to make the Java™ byte code (in 
a class file) "time aware". To ensure timely delivery of byte code, the 
appropriate deadlines are carried along with the content as time stamps to the 
clients. These time stamps are used in a header to facilitate such a delivery 
mechanism. The header is attached to the byte code to allow timely delivery 
of the byte code stream. 



One aspect of transmission that is addressed in timely delivery of byte 
M code is that of packet loss. Prior techniques have provided no way of 
1 10 recovering from a packet loss in the case of Java™ byte code streaming. One 

possible approach involves retransmission of the entire class at regular 
\ intervals in the absence of a back channel. This would help to facilitate 
I random access points in the case of media. However, this may not be possible 
J when the number of clients is too high or when the class (or object) is very 
J 15 large, making retransmission prohibitive. 

When a back channel is present packet loss can be signalled to the 
server, and the lost packet can be retransmitted. When a reliable multicast 
scheme is used, the data can also be retransmitted from places other than the 
20 server. 

There are a number of error resilient schemes with in built redundancy 
available for recovering from a partial packet loss. For example, schemes like 
forward error correction can be used. The packet loss problem can also be 
25 partially solved by using some reliable multicast scheme. Embodiments of 
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the invention facilitate the use of any error resilience or any reliable multicast 
algorithm to overcome packet loss. 

Another aspect that is addressed is that of security. To ensure the safety 
of the client, the byte code needs to authentic. There are a number of co™+y 
schemes that can be used to ensure the authenticity of the byte code. 
Embodiments of the invention also accommodate the use of any security 
scheme within the security model in the Java™ security APIs. 

A further aspect that is addressed is that of compression. Compression 
increases the efficiency of delivery by reducing the time required to transmit a 
given amount of information. A number of compression schemes, such as 
LZW, LZS, etc., are available to compress class files for efficiency. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is an embodiment of a Java™ network application 
environment. 

Figure 2 is a block diagram of an embodiment of a computer system 
capable of providing a suitable execution environment for an embodiment of 
the invention. 

Figure 3 is a block diagram of an embodiment of a class file format. 

Figure 4 is a diagram illustrating a header for class files or (serialized) 
objects to ensure timely delivery according to one embodiment of the 
invention. 

Figure 5 is a schematic diagram illustrating a technique for delivery of 
class files in a timely manner according to one embodiment of the invention. 

Figure 6 is a flow diagram illustrating a process by which byte code is 
20 prepared for timely delivery according to one embodiment of the invention. 

Figures 7 A and 7B are flow diagrams illustrating a process by which 
byte code is received and used in a timely manner according to one 
embodiment of the invention. 

25 
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Figure 8 is a flow diagram illustrating a process by which delivered byte 
code is prepared for execution and executed according to one embodiment of 
the invention. 



CP 

B 

C3 



h 
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DETAILED DESCRIPTION OF THE INVENTION 



The invention provides a method and apparatus for providing timely 
delivery of a byte code stream. In the following description, numerous 
5 specific details are set forth in order to provide a more thorough 

understanding of the present invention. It will be apparent, however, to one 
skilled in the art, that the present invention may be practiced without these 

5 ■: 

iS specific details. In other instances, well-known features have not been 
u i 

H described in detail in order not to unnecessarily obscure the present 

=F 

*S 10 invention. 

a 

0 Embodiment of Computer Execution Envir onment (Hardware) 

fc i 

1 t 

U. An embodiment of the invention can be implemented as computer 

*~ 15 software in the form of computer readable program code executed on a 

general purpose computer such as computer 200 illustrated in Figure 2, or in 
the form of bytecode class files executable by a virtual machine running on 
such a computer. A keyboard 210 and mouse 211 are coupled to a bi- 
directional system bus 218. The keyboard and mouse are for introducing user 
20 input to the computer system and communicating that user input to central 
processing unit (CPU) 213. Other suitable input devices may be used in 
addition to, or in place of, the mouse 211 and keyboard 210. I/O 
(input/output) unit 219 coupled to bi-directional system bus 218 represents 
such I/O elements as a printer, A/V (audio/ video) I/O, etc. 

25 
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Computer 200 includes a video memory 214, main memory 215 and 
mass storage 212, all coupled to bi-directional system bus 218 along with 
keyboard 210, mouse 211 and CPU 213. The mass storage 212 may include 
both fixed and removable media, such as magnetic, optical or magnetic optical 
5 storage systems or any other available mass storage technology. Bus *>i « 
contain, for example, thirty-two address lines for addressing video memory 

214 or main memory 215. The system bus 218 also includes, for example, a 

;| 32-bit data bus for transferring data between and among the components, such 
H as CPU 213, main memory 215, video memory 214 and mass storage 212. 

^0 10 Alternatively, multiplex data /address lines may be used instead of separate 
In data and address lines. 

%. \ 

J In one embodiment of the invention, the CPU 213 is a microprocessor 

U 

h manufactured by Motorola®, such as the 680X0 processor or a microprocessor 

U 15 manufactured by Intel®, such as the 80X86, or Pentium® processor, or a 
SPARC® microprocessor from Sun Microsystems®. However, any other 
suitable microprocessor or microcomputer may be utilized. Main memory 

215 is comprised of dynamic random access memory (DRAM). Video 
memory 214 is a dual-ported video random access memory. One port of the 

20 video memory 214 is coupled to video amplifier 216. The video amplifier 

216 is used to drive the cathode ray tube (CRT) raster monitor 217. Video 
amplifier 216 is well known in the art and may be implemented by any 
suitable apparatus. This circuitry converts pixel data stored in video memory 
214 to a raster signal suitable for use by monitor 217. Monitor 217 is a type of 

25 monitor suitable for displaying graphic images. 
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Computer 200 may also include a communication interface 220 coupled 
to bus 218. Communication interface 220 provides a two-way data 
communication coupling via a network link 221 to a local network 222. For 
5 example, if cor-- L V ion interface 220 is an integrated services digital 
network (ISDN) card or a modem, communication interface 220 provides a 
D data communication connection to the corresponding type of telephone line, 

[fi which comprises part of network link 221. If communication interface 220 is 

*g a local area network (LAN) card, communication interface 220 provides a data 

k| 10 communication connection via network link 221 to a compatible LAN. 
T' Wireless links are also possible. In any such implementation, 

r\ communication interface 220 sends and receives electrical, electromagnetic or 

ft optical signals which carry digital data streams representing various types of 

\t information. 
15 

Network link 221 typically provides data communication through one 
or more networks to other data devices. For example, network link 221 may 
provide a connection through local network 222 to host computer 223 or to 
data equipment operated by an Internet Service Provider (ISP) 224. ISP 224 in 

20 turn provides data communication services through the world wide packet 
data communication network now commonly referred to as the "Internet" 
225. Local network 222 and Internet 225 both use electrical, electromagnetic or 
optical signals which carry digital data streams. The signals through the 
various networks and the signals on network link 221 and through 

25 communication interface 220, which carry the digital data to and from 
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computer 200, are exemplary forms of carrier waves transporting the 
information. 

Computer 200 can send messages and receive data, including program 
5 code, through the network(s), network link 221, and communication interface 
220. In the Internet example, server 226 might transmit a requested code for 
□ an application program through Internet 225, ISP 224, local network 222 and 

(ft communication interface 220. In accord with the invention, one such 

.6 downloaded application is the apparatus for pre-processing and packaging 

■3 10 class files described herein. 



01 



The received code may be executed by CPU 213 as it is received, and/ or 
stored in mass storage 212, or other non- volatile storage for later execution. 
In this manner, computer 200 may obtain application code in the form of a 
15 carrier wave. 

The computer systems described above are for purposes of example 
only. An embodiment of the invention may be implemented in any type of 
computer system or programming or processing environment. 



20 



Class File Structure 



Embodiments of the invention can be better understood with reference 
to aspects of the class file format. Description is provided below of the Java™ 
25 class file format. Additional description of the Java™ class file format can be 
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found in Chapter 4, "The class File Format/' and Chapter 5, "Constant Pool 
Resolution," of The Java™ Virtual Machine Specification, by Tim Lindholm and 
Frank Yellin, published by Addison-Wesley in September 1996, © Sun 
Microsystems, Inc. 

5 

The Java™ class file consists of a stream of 8-bit bytes, with 16-bit, 32-bit 
□ and 64-bit structures constructed from consecutive 8-bit bytes. A single class 

Crt or interface file structure is contained in the class file. This class file structure 

H 

cp appears as follows: 

I 10 

in ClassFile { 

£ u4 magic; 

£3 u2 minor_version; 

Hi u2 major_version; 

M 15 u2 constant_pool_count; 

H cpjnfo constant_pool[constant_pool_count-l]; 

O u2 access_flags; 

u u2 this_class; 

u2 superclass; 
20 u2 interfaces_count; 

u2 interfaces [interfaces_count]; 

u2 fields_count; 

field„info fields[fields_count]; 

u2 methods_count; 
25 method_info methods[methods_count]; 

u2 attributes_count; 

attribute_info attributes[attributes_count]; 

} 



30 where u2 and u4 refer to unsigned two-byte and four-byte quantities. This 
structure is graphically illustrated in Figure 3. 



In Figure 3, class file 300 comprises four-byte magic value 301, two-byte 
minor version number 302, two-byte major version number 303, two-byte 
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constant pool count value 304, constant pool table 305 corresponding to the 
constant pool array of variable length elements, two-byte access flags value 
306, two-byte "this class" identifier 307, two-byte super class identifier 308, 
two-byte interfaces count value 309, interfaces table 310 corresponding to the 
5 interfaces array of two-byte elements, two-byte fields count value *1 1 C ^ }A ~ 
table 312 corresponding to the fields array of variable length elements, two- 
O byte methods count value 313, methods table 314 corresponding to the 

5 methods array of variable length elements, two-byte attributes count value 

3 315' and attributes table 316 corresponding to the attributes array of variable- 

% 10 length elements. Each of the above structures is briefly described below. 

Tin 

H Magic value 301 contains a number identifying the class file format. 

?* For the Java™ class file format, the magic number has the value 

j f. 

: 

y OxCAFEBABE. The minor version number 302 and major version number 

15 303 specify the minor and major version numbers of the compiler responsible 
for producing the class file. 

The constant pool count value 304 identifies the number of entries in 
constant pool table 305. Constant pool table 305 is a table of variable-length 
20 data structures representing various string constants, numerical constants, 
class names, field names, and other constants that are referred to within the 
ClassFile structure. Each entry in the constant pool table has the following 
general structure: 
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cp_info { 
ul tag; 
ul info[]; 

\ 

5 

where the one-byte "tag" specifies a particular constant type. The format of 
the info[] array differs based on the constant type. The info[] array may be a 
numerical value such as for integer and float constants, a string value for a 
3 string constant, or an index to another entry of a different constant type in the 

U 10 constant pool table. Further details on the constant pool table structure and 
J constant types are available in Chapter 4 of The Java™ Virtual Machine 

ifi Specification (supra). 

Access flags value 306 is a mask of modifiers used with class and 
Ji 15 interface declarations. The "this class" value 307 is an index into constant 
O pool table 305 to a constant type structure representing the class or interface 

defined by this class file. The super class value 308 is either zero, indicating 
the class is a subclass of java.lang.Object, or an index into the constant pool 
table to a constant type structure representing the superclass of the class 
20 defined by this class file. 

Interfaces count value 309 identifies the number of direct 
superinterfaces of this class or interface, and accordingly, the number of 
elements in interfaces table 310. Interfaces table 310 contains two-byte indices 
25 into constant pool table 305. Each corresponding entry in constant pool table 
305 is a constant type structure representing an interface which is a direct 
superinterface of the class or interface defined by this class file. 
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The fields count value 311 provides the number of structures in fields 
table 312. Each entry in fields table 312 is a variable-length structure 
providing a description of a field in the class type. Fields table 312 includes 
5 only those fields that are declared by the class or interface defined by this class 
file. 

The methods count value 313 indicates the number of structures in 
methods table 314. Each element of methods table 314 is a variable-length 

Ji 10 structure giving a description of, and virtual machine code for, a method in 
I" the class or interface. 



The attributes count value 315 indicates the number of structures in 
attributes table 316. Each element in attributes table 316 is a variable-length 
15 attribute structure. Attribute structures are discussed in section 4.7 of Chapter 
4 of The Java™ Virtual Machine Specification (supra). 

Embodiments of the invention enable timely delivery of Java™ byte 
code in a multicast/broadcast scenario with or without a back channel. The 
20 same mechanisms can also be used for delivering (serialized) objects. 

Multicasting allows transmission of a specially addressed data stream to many 
users. With multicasting, the data stream does not need to be individually 
transmitted to each user. Rather, the users can subscribe to the multicasting 
service, for example by specifying the address of the specially addressed data 
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stream. Broadcasting allows transmission to users without the subscription 
process of multicasting. 

Embodiments of the invention are suitable for use with "push" media, 
5 where information is transmitted to users without the need for users to 
request the information. "Push" media can be transmitted even in 
□ environments where there is no back channel to allow the users to 

CH communicate back to the source of the media. Embodiments of the 

lp invention are also suitable for use with "pull" media, where users request 

sti 10 information from the source of the media. 

Em 

:1 Embodiments of the invention serve to make the Java™ byte code (in 

[2 a class file) "time aware". To ensure timely delivery of byte code, the 

jl appropriate deadlines are carried along with the content as time stamps to the 

15 clients. These time stamps are used in a header to facilitate such a delivery 

mechanism. The header is attached to the byte code to allow timely delivery 

of the byte code stream. 

One aspect of transmission that is addressed in timely delivery of byte 
20 code is that of packet loss. Prior techniques have provided no way of 

recovering from a packet loss in the case of Java™ byte code streaming. One 
possible approach involves retransmission of the entire class at regular 
intervals in the absence of a back channel. This would help to facilitate 
random access points in the case of media. However, this may not be possible 
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u 



when the number of clients is too high or when the class (or object) is very 
large, making retransmission prohibitive. 

When a back channel is present packet loss can be signalled to the 
server, and the lost packet can be retransmitted. When a reliable mniti^c* 
scheme is used, the data can also be retransmitted from places other than the 
server. 



There are a number of error resilient schemes with in built redundancy 
10 available for recovering from a partial packet loss. For example, schemes like 
forward error correction can be used. The packet loss problem can also be 
partially solved by using some reliable multicast scheme. Embodiments of 
M the invention facilitate the use of any error resilience or any reliable multicast 

algorithm to overcome packet loss. 



15 

Another aspect that is addressed is that of security. To ensure the safety 
of the client, the byte code needs to authentic. There are a number of security 
schemes that can be used to ensure the authenticity of the byte code. 
Embodiments of the invention also accommodate the use of any security 
20 scheme within the security model in the Java security APIs. 

A further aspect that is addressed is that of compression. Compression 
increases the efficiency of delivery by reducing the time required to transmit a 
given amount of information. A number of compression schemes, such as 
25 LZW, LZS, etc., are available to compress class files for efficiency. 
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Figure 5 is a schematic diagram illustrating a technique for delivery of 
5 class files in a timoUr manner according to one embodiment of the invention. 
Class file (or object) 501 is provided. Class file (or object) 501 may or may not 
be processed according to one or more suitable optional compression, error- 
resilience, and security schemes. Header 502 is added to the class file (or 
object) 501. Class file (or object) 501 with header 502 is passed to transport 
10 mechanism 508 for delivery elsewhere. Transport mechanism 508 uses 

packetizer 503 to transport class file (or object) 501 with header 502 as a series 
of packets 504, 505, 506, and 507. Transport mechanism 508 determines the 
appropriate number of packets in which to transport any given class file (or 
object) 501 with header 502. 



15 



Figure 4 is a diagram illustrating a header for class files or (serialized) 
objects to ensure timely delivery according to one embodiment of the 
invention. This header, shown as a byte code header, is attached to the class 
file before it is packetized as illustrated in Figure 5. After packetization, any 
20 "time aware" transport mechanism (e.g., RTP, MPEG-2 transport stream, etc.) 
can be used to transport the data to the client side. This scheme can be 
adopted for any particular media content (e.g., MPEG-1, MPEG-2, etc.) and 
transport mechanism (MPEG-2 transport stream, RTP, etc.) by defining the 
tables for compression, security, and error resiliency schemes. 



25 
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One embodiment of a header comprises information representing the 
length of the header, the version, a flag denoting a class or an object, the 
number of required classes, a "start loading" time stamp, a "load by" time 
stamp, the size of the class, the type of compression being used, the type of 
5 security scheme being used, the type of error correction being used, other type 
information, the length of the class identifier (ID), the class identifier (ID), the 
n lengths of the class ID for each of the required classes, and the class IDs for 
frt each of the required classes. 

^ 10 One embodiment of length of header information 401 comprises 16 bits 

ys denoting the size in bytes of the header added to the byte code file to provide 
jpj timely delivery. One embodiment of version information 402 comprises two 
bits denoting the version of the scheme used to provide timely delivery of the 

□ byte code file. One embodiment of class/object flag 403 comprises one bit 

B 

15 denoting whether the byte code file to which the header is appended is a class 
or an object. For example, a one represents a class while a zero represents an 
object. 

One embodiment of the number of required classes information 404 
20 comprises 13 bits denoting the number of classes that are required before 
loading this class (or before instantiation, in case of objects). One 
embodiment of the "start loading" time stamp 405 comprises 64 bits denoting 
the time after which class loading can begin once the class has been received 
and re-assembled completely. The length of the time stamps are set to 64 bits 
25 to accommodate NTP time stamps. Time stamps of fewer bits are padded 
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with extra bits to fill the 64-bit length. Each scheme can define the location of 
the decimal point to represent fractional time stamps. In cases where clock 
ticks are used (MPEG-2), all 64 bits can be used. 

5 The time stamps may comprise representations of absolute or relative 

time. For example, the time stamps may represent the actual time of day or 
some other absolute measurement of time, or the time stamps may represent 
the time elapsed since the beginning of a session, the occurrence of an event, 
or some other relative measurement of time. 

10 

One embodiment of the "load by" time stamp 406 comprises 64 bits 
denoting the time by which the class has to be loaded absolutely. One 
embodiment of the size of class information 407 comprises 16 bits denoting 
the size in bytes of the data that is being transmitted. 

15 

One embodiment of the invention comprises type fields. Compress 
type field 408 comprises 4 bits to specify the type of compression used (0000 for 
objects or when no compression is used). Security type 409 field comprises 4 
bits to specify the security scheme used (0000 if none used). Error correction 
20 type field 410 comprises 4 bits to specify the error correction scheme used (0000 
if none used). Type field 411 comprises 4 bits that are reserved for future use. 

One embodiment of class ID length information 412 comprises 32 bits 
denoting the length in bytes of class ID information 413. Class ID information 
25 413 comprises a variable length string that identifies the classes (unique to 
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each session). The string is padded so that the length of the combination of 
class ID length information 412 and class ID information 413 is a multiple of 
32 bits. 

5 One embodiment of the header also comprises the class IDs ^ 

lengths for each of the required classes. Class ID 1 length information 414 
n comprises 16 bits of information denoting the length of the class ID for the 
rtj first required class. Class ID 1 information 415 comprises a variable length 
5 string that identifies the first required class and that is padded so that the 
;Jj 10 combined length of class ID 1 length information 414 and class ID 1 

-J3ZE. 

yi information 415 is a multiple of 32 bits. 

~. . : 

M" Class ID length information and class ID information for required 

□ classes beyond the first required class follow class ID 1 information 415 and 
15 occupy region 416. Class ID n length information 417 comprises 16 bits and 
specifies the length of the class ID for the nth required class. Class ID n 
information 418 comprises a variable number of bits that identify the nth 
required class and are padded to the next 32 bit boundary. 

20 In one embodiment of the invention, each class is packaged as a 

separate unit. Thus, a header is appended to each class to enable timely 
delivery. Timely delivery is facilitated by providing a time frame within 
which the class is to be loaded. A "start loading" time stamp is provided for 
each class to indicate the time after which that class can be loaded. A "load 

25 by" time stamp is provided for each class to indicate the time by which each 
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class needs to be loaded. The "load by" time stamp provides the guaranteed 
time after which the class can be expected to be available at the application. 

The payload delivered by this scheme can be classes (compressed or 
5 uncompressed} : hu^nces. To provide efficient, secure, and reliable Th^re 
are three type fields in the header, which specify the attributes of the data 
(class or object). 

Any suitable compression scheme may be used in conjunction with an 
10 embodiment of the present invention. A portion (e.g., 4 bits) of the header is 
designated to provide identification of the type of compression scheme used. 
For example, the bit pattern 0000 is used to denote no compression, while the 
bit patterns 0001 through 1111 are used to denote specific compression 
techniques. 

15 

Any suitable security scheme may be used in conjunction with an 
embodiment of the present invention. A portion (e.g., 4 bits) of the header is 
designated to provide identification of the type of security scheme used. For 
example, the bit pattern 0000 is used to denote no use of a security scheme, 
20 while the bit patterns 0001 through 1111 are used to denote specific security 
schemes. 

Any suitable error resiliency scheme may be used in conjunction with 
an embodiment of the present invention. A portion (e.g., 4 bits) of the header 
25 is designated to provide identification of the type of error resiliency scheme 
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used. For example, the bit pattern 0000 is used to denote no use of an error 
resiliency scheme, while the bit patterns 0001 through 1111 are used to denote 
specific error resiliency schemes. A portion (e.g., 4 bits) of the header is 
reserved for future use. 

5 

One benefit of the use of an error resiliency scheme is that unreliable 
f = protocols, such as UDP, may be used to transmit byte code. Byte code that is 
J2 incomplete or that has been affected by errors will not execute properly, 
v Unreliable protocols, such as UDP, do not guarantee complete and error-free 

*f ' 10 delivery of information. However, the addition of an error resiliency scheme 

SSL? 

Cfi allows completeness to be verified and errors to be corrected before byte code 
£3 is executed. Thus, the transmission of byte code is no longer constrained to 

U only reliable transport mechanisms. 

%=s 15 Classes are identified by an ID, which is unique to the session. This ID 

can be used to identify classes when it is received multiple times. This can be 
used by objects to identify the class of which each is an instance. Java™ class 
names are used as ID's. Since these are variable length strings, the length of 
the string is also included in the header. The combination of the Class ID and 
20 its length (16 bits) are padded to the next 32-bit boundary. 

Embodiments of the invention also provide a list of required classes. 
The "load by" time of each required class needs to be before the "start loading" 
time of a class that requires it. A 13-bit number is used to specify the number 
25 of classes that are required before loading/ instantiating the class/object data. 
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The required classes are specified by their Class ID's (along with the length of 
their class ID's). 

Figure 6 is a flow diagram illustrating a process by which byte code is 
5 prepared for timely delivery according to one embodiment of the invention. 
The process begins in step 601. In step 602, the byte code to be delivered is 
O provided. In step 603, any desired compression, error resilience, and security 
m schemes are performed on the byte code. Any combination of compression, 
V error resilience, and security schemes may be performed in any order. For 
S 10 example, a security schemes may be applied, followed by an error resilience 
!' : scheme without the use of a compression. Thus, any permutation of 

H compression, error resilience, security schemes, or subsets thereof may be 
H used. In step 604, a header is attached to the byte code. The header comprises 
5 information about the byte code. One embodiment of such a header is 

15 described with respect to Figure 4 above. Although the header is described as 
being attached to the byte code such that the header information precedes the 
byte code, the header can be located at any position with respect to the byte 
code, for example, at the end of the byte code, between portions of the byte 
code, or interleaved with the byte code. 

20 

In step 605, the byte code with the attached header is delivered via a 
transport mechanism. Any suitable transport mechanism may be used. For 
example, a transport mechanism that, by itself, guarantees delivery, but does 
not guarantee the timing of delivery, such as TCP, may be used. 
25 Alternatively, a transport mechanism that guarantees timeliness, such as 
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RTP, may be used. As another alternative, a transport mechanism that does 
not guarantee delivery, such as UDP, may be used. In step 606, the process 
ends. 

5 Figures 7 A and 7B are flow diagrams illustrating a process hy -^-t- 

byte code is received and used in a timely manner according to one 
£3 embodiment of the invention. The process begins in step 701. In step 702, the 
Cm byte code with the attached header is received via a transport mechanism. 

'IS, 

lp The transport mechanism may be any suitable transport mechanism. In step 

5 10 703, the information contained in the header is read. In step 704, a decision is 

fn 

T made as to whether or not additional classes need to be loaded before the byte 

Q 

H code can be executed. Information used to make this determination may be 

?T extracted from the header. If additional classes need to be loaded, the process 

p« 

*i continues in step 706. 

15 

In step 706, a decision is made as to whether or not the "start loading 
time" specified in the header has passed yet. If not, the process returns to step 
706 and waits until the "start loading time" has arrived. If the "start loading 
time" has arrived, the process continues in step 708 via reference B 707. In 

20 step 708, the required classes are loaded. In step 709, a decision is made as to 
whether or not all required classes have been loaded. If not, the process 
continues to step 710. In step 710, a decision is made as to whether or not the 
"load by time" specified in the header has passed. If the "load by time" has 
not passed, the process returns to step 708, where the loading of required 

25 classes continues. If, in step 710, the "load by time" has already passed, the 
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process continues to step 712. In step 712, the late loading error is handled. 
The late loading error handling may comprise notification that the required 
classes could not be loaded successfully by the "load by time" deadline. Based 
on this notification, a decision can be made as to whether the loading should 
5 be rescheduled ( f — 2: .imple, by specifying a new "load by time" deadline or 
whether the loading process should be cancelled (without execution of the 

Q byte code). From step 712, the process ends in step 713. 

sQ 

is : 

: 

j If in step 709, all required classes have been loaded, the process 

S 10 continues in step 711. Also, if in step 704, no additional classes needed to be 

loaded, the process continues in step 711 via reference A 705. In step 711, the 
l*\ byte code is executed. The execution of the byte code may involve additional 

steps if security, compression, and /or error resilience schemes have been 
O performed on the byte code. An example of a process comprising certain 

15 additional steps is illustrated in Figure 8. From step 711, the process ends in 

step 713. 

Figure 8 is a flow diagram illustrating a process by which delivered byte 
code is prepared for execution and executed according to one embodiment of 

20 the invention. The process begins in step 801. In step 802, a decision is made 
as to whether or not a security scheme has been used. If a security scheme has 
been used, the process continues to step 803. In step 803, the security scheme 
that has been used is identified and the byte code is processed according to that 
security scheme. Identification of the security scheme may be performed 

25 based on information found in the header information, such as that read in 
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step 703. From step 803, the process continues to step 804. If, in step 802, it is 
determined that no security scheme was used, the process continues in step 
804. 

5 In step 804, a decision is made as to whether or not a compression 

scheme has been used. If a compression scheme has been used, the process 
continues to step 805. In step 805, the compression scheme that was used is 
identified and the byte code is decompressed according to that compression 
scheme. Identification of the compression scheme may be performed based 
10 on information found in the header information, such as that read in step 
703. From step 805, the process continues in step 806. If, in step 804, it is 
determined that no compression scheme has been used, the process continues 
in step 806. 

15 In step 806, a decision is made as to whether or not an error resilience 

scheme has been used. If an error resilience scheme has been used, the 
process continues to step 807. In step 807, the error resilience scheme that was 
used is identified and any errors or omissions that may have occurred are 
corrected or compensated. Identification of the compression scheme may be 

20 performed based on information found in the header information, such as 
that read in step 703. From step 806, the process continues in step 808. If, in 
step 806, it is determined that no error resilience scheme was used, the process 
continues in step 808. 



\ 

\ 

\ 

\ 
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In step 808, the byte code is executed. Since one embodiment of the 
invention provides a mechanism for insuring that all required classes have 
been loaded before attempting execution of the byte code, successful execution 
of the byte code is provided. In step 809, the process ends. 

Thus, a method and apparatus for providing timely delivery of a byte 
code stream has been described in conjunction with one or more specific 
embodiments. The invention is defined by the claims and their full scope of 
equivalents. 
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